A method and system for creating a light script for a video

ABSTRACT

A method of creating a light script for a video is disclosed. The light script comprises lighting control instructions for controlling one or more light sources when the video is being displayed. The method (600) comprises: —receiving a user input indicative of a selection of a lighting control instruction for a scene (S1, S11, S21, S31, S32), —associating the lighting control instruction (L1, L11, L21, L31, L32) with the scene (S1, S11, S21, S31, S32), —analyzing (602) the scene (S1, S11, S21, S31, S32) of the video to identify a scene characteristic (C1, C11, C21, C31, C32) in the scene, —analyzing (604) the video or another video to recognize, in a further scene (S4, S13, S24, S34), a similar or identical scene characteristic (C1, C11, C21, C31, C32), and —associating (606), based on the recognition of the similar or identical scene characteristic (C1, C11, C21, C31, C32), the lighting control instruction (L1, L11, L21, L31, L32) with the further scene (S4, S13, S24, S34), such that when the scene (S1, S11, S21, S31, S32) and the further scene (S4, S13, S24, S34) are being displayed the one or more light sources are control led according to the lighting control instruction (L1, L11, L21, L31, L32).

FIELD OF THE INVENTION

The invention relates to a method of creating a light script for avideo. The invention further relates to a computer program product forexecuting the method. The invention further relates to a system forcreating a light script for a video.

BACKGROUND

The number of connected lighting systems in home environments isincreasing. These connected lighting systems comprise light sourceswhich can be controlled individually, for example based on controlsignals received from a smart device, such as a smartphone.Additionally, these light sources can be controlled based on othercontent, such as video content. U.S. patent application 2009/176569 A1discloses a system configured to control connected light sources basedon content that is being displayed on a television. The light sourcesare controlled real-time based on an analysis of the on-screen content.An alternative to such real-time lighting control based on video contentis to provide light scripts for these videos. U.S. patent application2008/263620 A1, for example, discloses that light scripts comprisepreprogrammed/predefined lighting control instructions for controllingone or more light sources when a video is being displayed, whichlighting control instructions are communicated to the connected lightingsystem while the video is being displayed such that light effectscreated by the light sources are synchronized with on-screen events.Creating such a preprogrammed/predefined light script can be cumbersome,because it requires a movie producer or a lighting designer to manuallyselect light settings for each video scene/video event.

SUMMARY OF THE INVENTION

It is an object of the present invention to simplify the process ofcreating light scripts for videos.

According to a first aspect of the present invention, the object isachieved by a method of creating a light script for a video, the lightscript comprising lighting control instructions for controlling one ormore light sources when the video is being displayed, the methodcomprising:

receiving a user input indicative of a selection of a lighting controlinstruction for a scene,

associating the lighting control instruction (L1, L11, L21, L31, L32)with the scene,

analyzing the scene of the video to identify a scene characteristic inthe scene,

analyzing the video or another video to recognize, in a further scene, asimilar or identical scene characteristic, and

associating), based on the recognition of the similar or identical scenecharacteristic, the lighting control instruction with the further scene,such that when the scene and the further scene are being displayed theone or more light sources are controlled according to the lightingcontrol instruction.

By analyzing the video (or another video) for identifying further sceneshaving similar/identical characteristics to the scene characteristic ofthe (initial) scene, and by associating a lighting control instructionwith the (initial) scene and the further scenes, the light sources of alighting system are controlled according to the same lighting controlinstruction for similar/identical video scenes. This is beneficial,because it reduces the number of (manual) inputs required forgenerating/creating the light script, and it thereby simplifies thecreation of the light script for the video. An additional benefit ofthis method, is that the light effects generated by the light sourcesare consistent throughout the video. This may be further beneficial whenanother video (different from the video wherein the scene has beenidentified) is analyzed for similar/identical scenes, because it createsconsistency between light effects for related videos (e.g. differentepisodes of a tv-show, related movies, intro scenes for movies, etc.).

The lighting control instruction may be obtained in different ways.

The method comprises receiving a user input indicative of a selection ofthe lighting control instruction for the scene. This embodiment enablesa user to determine how the light sources are to be controlled duringthe scene (and, consequently, during the further scene). This step mayoccur before or after the analysis steps. In embodiments wherein theuser input is received before the analysis of the scene or before theanalysis of the video or the other video, a user may first select howthe light sources are to be controlled during the scene, whereupon therest of the video (or another video) is analyzed for similar/identicalscenes, whereafter the user-defined lighting control instruction isapplied to those similar/identical scenes. This is beneficial, becauseonce a user has determined a lighting control instruction for a certainscene, that lighting control instruction is automatically copied to thesimilar/identical scenes, thereby removing the need for manually copyingor creating the lighting control instructions for thosesimilar/identical scenes.

The lighting control instruction may further comprise:

extracting one or more colors from one or more images of the scene, and

generating the lighting control instruction based on the one or morecolors. This enables automatic creation of the lighting controlinstruction, whereafter the automatically generated lighting controlinstruction is applied to similar/identical scenes. This furthersimplifies the creation of the light script for the video.

The lighting control instruction may comprise color information,position information and/or timing information for controlling the oneor more light sources. The color information may relate to the color,brightness and/or saturation of the light emitted by the one or morelight sources when the video is being displayed. The positioninformation may relate to where a certain light effect is to be createdwhen the video is being displayed (e.g. left/right of the display,above/below the display, in front/behind a user, etc.). The timinginformation may relate to when a certain light effect is created whenthe video is being displayed.

The method may further comprise associating the lighting controlinstruction with one or more intermediate scenes of the video in betweenthe scene and the further scene. This may be beneficial when a certainlight effect is present during the scene and the further scene (e.g. afire light effect during a fire scene), but should continue along theintermediate scenes in between those scenes (for instance, it may bedesirable to continue the fire light effect during a close-up of anactor in between two fire scenes). The step of associating the lightingcontrol instruction with the one or more intermediary scenes may beexecuted (only) if a pre-defined condition is met.

The step of associating the lighting control instruction with the one ormore intermediary scenes may be executed (only) if a time period betweenthe scene and the further scene is below a threshold time period. Thus,when the time period between a first scene having a certaincharacteristic and a second scene having the same characteristic isshorter than a predefined time period, the lighting control instructionis also associated with the scenes in between the first and the secondscene.

The method may further comprise the steps of:

analyzing the scene, the further scene and the one or more intermediaryscenes,

identifying a secondary scene characteristic, different from the scenecharacteristic, in each of the scene, the further scene and the one ormore intermediary scenes,

wherein the step of associating the lighting control instruction withthe one or more intermediary scenes is executed if the secondary scenecharacteristic has been identified in the scene, the further scene andthe one or more intermediary scenes.

The step of analyzing the scene to identify the scene characteristic maycomprise identifying at least one object, shape, character and/or personin the scene, and the step of analyzing the video or another video torecognize, in the further scene, the scene characteristic may compriserecognizing the at least one recognized one object, shape, characterand/or person in the further scene. It may be beneficial to analyze thescenes of the video (or the other video) for visual characteristics suchas objects, shapes, characters and/or persons, because this may createconsistency between light effects for related visual characteristics.

The step of analyzing the scene to identify the scene characteristic maycomprise identifying at least one audio fragment in the scene, and thestep of analyzing the video or another video to recognize, in thefurther scene, the scene characteristic may comprise recognizing the atleast one recognized audio fragment in the further scene. It may bebeneficial to analyze the scenes of the video (or the other video) forauditory characteristics such as songs, sound effects or voices, becausethis may create consistency between light effects for related auditorycharacteristics.

The step of analyzing the scene to identify the scene characteristic inthe scene may comprise identifying a plurality of scene characteristicsin the scene, and the method may further comprise:

communicating the plurality of scene characteristics to a user via auser interface,

receiving one or more user inputs representative of a selection of oneor more of the plurality of scene characteristics,

and the analysis of the video or another video may comprise recognizing,in the further scene, the one or more selected scene characteristics.This enables a user to select one or more characteristics in the(initial) scene of the video which may subsequently be used for analysisof other scenes of the video (or the other video).

The method may further comprise:

obtaining a first weight value for a first scene characteristic in afirst scene associated with a first lighting control instruction,

obtaining a second weight value for a second scene characteristic in asecond scene associated with a second lighting control instruction, and

associating, if the first and second scene characteristics arerecognized in the further scene, the first or the second lightingcontrol instruction with the further scene based on the first and secondweight values. A user, for example, may provide a weight value for eachof the scene characteristics. Thus, if a further scene has scenecharacteristics of multiple (initial) scenes, the weight value of thescene characteristics of the (initial) scenes may be decisive indetermining with which lighting control instruction of which (initial)scene the further scene is associated.

The method may further comprise, before associating the lighting controlinstruction with the further scene, receiving a user input indicative ofan acceptance of the association between the lighting controlinstruction and the further scene. This enables the user toapprove/accept that the lighting control instruction of the furtherscene is to be applied to/associated with the further scene, which isbeneficial because it provides a higher level of user control.

The method may further comprise storing the light script as a computerreadable file, or embedding the light script in a video file of thevideo. Storing the light script as a computer readable file separatefrom the video file may be beneficial, because the video content may beprovided via a different service than the light script. A video playbackdevice may, for example, play the video content, while simultaneously, alighting control device may control light sources of a lighting systemsynchronously according to the lighting control instructions of thelight script. Alternatively, the light script may be encoded togetherwith the actual video stream, which may be beneficial for devices thatare configured to display the video and transmit lighting controlcommands based on the lighting control instructions of the light scriptto light sources of a lighting system.

According to a second aspect of the present invention, the object isachieved by a computer program product for a computing device, thecomputer program product comprising computer program code to perform anyone of the above-mentioned methods when the computer program product isrun on a processing unit of the computing device.

According to a third aspect of the present invention, the object isachieved by a system for creating a light script for a video, the lightscript comprising lighting control instructions for controlling one ormore light sources when the video is being displayed, the systemcomprising

a user interface configured to receive a user input indicative of aselection of a lighting control instruction for a scene, and

a processor configured to associate the lighting control instructionwith the scene, analyze the scene to identify a scene characteristic inthe scene, analyze the video or another video to identify, in a furtherscene, a similar or identical scene characteristic, and to associate,based on the recognition of the similar or identical scenecharacteristic, the lighting control instruction with the further scene,such that when the scene and the further scenes are being displayed theone or more light sources are controlled according to the lightingcontrol instruction.

The system may further comprise a memory configured to store the createdlight script.

It should be understood that the claimed system may have similar oridentical embodiments and advantages as the claimed method.

In the context of the present invention the term “scene characteristic”relates to an (image) characteristic of the scene that can be identifiedby analyzing one or more images of the scene, for example by applyingknown image recognition techniques. Alternatively, the term relates to acharacteristic of the scene that can be identified by analyzing theaudio stream of the video. Examples of scene characteristics include butare not limited to objects (such as vehicles, machines, plants,infrastructure elements, etc.), materials (such as metals, wood, ice,etc.), shapes of objects, people (such as actors), characters (such asanimals, fictitious characters, etc.), dominant colors, events (such asexplosions, natural phenomena, specific motions of specific objects,people or characters, etc.) and audio fragments (e.g. songs, spokenaudio, background music, sound effects, etc.).

In the context of the present invention the term “lighting controlinstruction” relates to lighting control instructions for one or morelight sources or for a lighting system that may control one or morelight sources according to the lighting control instructions. Thelighting control instruction may, for example, comprise lighting controlcommands which are configured to be executed by a lighting system or byone or more light sources. The lighting control instruction may, forexample, comprised instructions for controlling the light sourcesaccording to a certain color, brightness and/or saturation. Inembodiments, the lighting control instruction may be a controlinstruction to turn the light sources off.

In the context of the present invention the term “scene” relates to asequence of images of the video and, optionally, the audio thatcorresponds to that scene. The scene may, for example, be at least apart of an (uninterrupted) on-screen action. The action may occur in thevideo in a single location and continuous time. In embodiments, a scenemay also be an on-screen action that occurs in the video at multiplelocations over time, which has a common scene characteristic (e.g. acommon audio track, a common actor, a common event, etc.).

The duration of the further scene may be similar/identical to theduration of the (initial) scene. The (initial) scene and the furtherscene may, for example, be identical scenes such as opening scenes ofdifferent episodes of a tv-show. The duration of the further scene maybe different from the duration of the (initial) scene. The (initial)scene may, for example, be a scene comprising a fire, and the furtherscene may, for example, also comprise a fire and have a longer duration.A duration of the further scene(s) may be determined based on a userinput. A user may, for example, provide a user input indicative of adesired minimum or maximum duration for a further scene.

BRIEF DESCRIPTION OF THE DRAWINGS

The above, as well as additional objects, features and advantages of thedisclosed systems, devices and methods will be better understood throughthe following illustrative and non-limiting detailed description ofembodiments of devices and methods, with reference to the appendeddrawings, in which:

FIG. 1 shows schematically an embodiment of a system for creating alight script for a video; and

FIG. 2 shows schematically an example of a timeline of a plurality ofscenes of a video, scene characteristics of these scenes and lightingcontrol instructions associated therewith;

FIG. 3 shows schematically an example of a time line of a plurality ofscenes of a video;

FIGS. 4a and 4b schematically show examples of a timeline a plurality ofscenes of a video, wherein a lighting control instruction is associatedwith intermediate scenes which lack the scene characteristic;

FIG. 4c schematically shows an example of a timeline a plurality ofscenes of a video, wherein different scene characteristics havedifferent weight values;

FIG. 5 shows schematically an embodiment of a user interface forcreating a light script for a video; and

FIG. 6 shows schematically a method of creating a light script for avideo.

All the figures are schematic, not necessarily to scale, and generallyonly show parts which are necessary in order to elucidate the invention,wherein other parts may be omitted or merely suggested.

DETAILED DESCRIPTION OF EMBODIMENTS

FIG. 1 illustrates a system 100 for creating a light script for a video.The light script of the video comprises lighting control instructionsfor controlling one or more light sources (not shown) when the video isbeing displayed. The system 100 comprises a processor 102 configured toanalyze the scene to identify a scene characteristic in the scene,analyze the video or another video to identify, in a further scene, thesame scene characteristic, and to associate the lighting controlinstruction with the scene and the further scene, such that when thescene and the further scene are being displayed the one or more lightsources are controlled according to the lighting control instruction.This is further illustrated in FIG. 2, which shows a timeline of a videocomprising a plurality of scenes S1-S7. The processor 102 may analyze ascene, for example scene S1, and identify a scene characteristic C1therein. The processor 102 may further analyze the remaining scenesS2-S7 of the video and recognize the scene characteristic C1 in scene S4as well, whereupon the processor 102 may associate a lighting controlinstruction L1 with the scenes S1 and S4.

The processor 102 (e.g. a microchip, circuitry, a microcontroller, etc.)may for example be comprised in a computer system such a desktop pc, atablet pc, a smartphone, etc. The video may be stored locally in amemory of a device comprising the processor 102 and a memory 106.Alternatively, the video may be stored remotely and the processor 102may access the video via a network.

The processor 102 is configured to associate a lighting controlinstruction with the scene (and the further scene) of the video. Thelighting control instruction may be related to color information,position information and/or timing information for controlling the oneor more light sources. The color information may relate to the color,brightness and/or saturation of the light emitted by the one or morelight sources when the video is being displayed. The positioninformation may relate to where a certain light effect is to be createdwhen the video is being displayed (e.g. left/right of the display,above/below the display, in front/behind a user, etc.). If the locationsof light sources relative to a display where the video will be displayedare known, the light sources can be controlled according to the positioninformation of the lighting control instructions. A controller of thelighting system may be configured to map the position information of thelighting control instruction onto the actual light sources. The timinginformation may relate to when a certain light effect is created whenthe video is being displayed. Some light effects may be dynamic lighteffects (i.e. light effects that change over time). The timinginformation may relate to when a color of the light emitted by a lightsource should change.

The processor 102 may be configured to obtain the lighting controlinstruction. The lighting control instruction for the scene may beobtained in different ways. For example, the processor 102 may becoupled to a user interface for creation of lighting controlinstructions (see for example FIG. 5, explained below). The userinterface may be configured to receive a user input indicative of aselection of the lighting control instruction for the scene, and thelighting control instruction may be based on the user input. The userinterface, for example a touch interface, a gesture-based interface, avoice based interface, etc., may have an input means (e.g. touch,gesture, voice) for receiving the user input. The user input may, forexample, relate to a selection of a static light color (e.g. a bluecolor resembling water) or a dynamic light color (e.g. a flickeringorange color resembling a fire) for the scene, and the processor 102 maygenerate a lighting control instruction for the scene comprising alighting control command for controlling the one or more light sourcessuch that they emit light according to the static/dynamic color selectedby the user when the video is being displayed. The user input may befurther related to a selection of a position for a selected color, andthe processor 102 may generate the lighting control instruction suchthat it further comprises position information for the selected color. Alighting control system may be configured to control one or more lightsources with known positions relative to a display displaying the videoaccording to the position of the color.

Additionally or alternatively, the processor 102 may be configured toanalyze a scene to extract one or more colors from one or more images ofthe scene, and generate the lighting control instruction based on theone or more colors. The processor 102 may, for example, extract one ormore dominant colors from one or more images of the scene and generatethe lighting control instruction based on the one or more dominantcolors. In another example, the processor 102 may analyze one or moreimages of the scene and use known image analysis techniques to recognizefor example an object, an event or a person (e.g. a vehicle, a burningfire, an explosion, a movie character, etc.) and generate the lightingcontrol instruction based thereon. For example, a burning fire may bedetected in the scene, and the processor 102 may generate a lightingcontrol instruction for the scene comprising a lighting control commandfor controlling the one or more lighting devices such that they resemblethe burning fire.

Additionally, the processor 102 may be configured to determine positionsof the extracted one or more colors in the one or more images, andgenerate the lighting control instruction based thereon. The processor102 may, for example, extract a blue (sky) color from the top of the oneor more images, and extract a green (grass) color from the bottom of theone or more images. The processor 102 may thereafter generate thelighting control instruction such that it further comprises positioninformation for the colors (blue above, green below). A lighting controlsystem may be configured to control one or more light sources with knownpositions relative to a display displaying the video according to thepositions of the colors (e.g. by controlling ceiling luminaires suchthat they emit the blue light, and floor luminaires such that they emitgreen light).

The system 100 may comprise a user interface configured to receive auser input indicative of an acceptance of the association between thelighting control instruction and the further scene. Upon receiving theacceptance, the processor 102 may associate the lighting controlinstruction with the further scene.

The processor 102 is further configured to analyze the scene to identifya scene characteristic in the scene. The processor 102 may use knownimage analysis techniques to extract one or more features from one ormore images of the scene. The processor 102 may, for example, identifyan object (a vehicle 110 in FIG. 1) in the scene. A user may, forexample, associate a lighting control instruction with that scene (e.g.a lighting control instruction to set the color of the one or more lightsources to a color similar to the vehicle's 110 color). Afteridentifying the scene characteristic, the processor 102 analyses otherscenes of the video (or scenes of another video) to determine whetherthe scene characteristic (the vehicle 110 in FIG. 1) is present inanother (further) scene of the video. If, for example, the vehicle 110is present in one or more other (further) scenes, the processor 102associates the lighting control instruction with those scenes. As aresult, when the video is being displayed, each time the vehicle 110 isshown on a display/screen, the one or more light sources are controlledaccording to the same lighting control instruction (which in thisexample would result in that the light sources are controlled accordingto the color of the vehicle each time it appears on screen).

The processor 102 may be further configured to store the light script asa computer readable file, separate from the video file. This enablesdistributed video playback and lighting control. A video playback device(such as a television, a smartphone, a set-top box, a digital mediaplayer, etc.) may, for example, play the video content, whilesimultaneously, a lighting control device (such as a smartphone, abridge, a home control system, etc.) may control light sources of alighting system synchronously according to the lighting controlinstructions of the light script. The light script (and the video) maybe streamed from a remote server. Additionally or alternatively, theprocessor 102 may be configured to embed the light script in a videofile of the video. The light script may be encoded together with theactual video stream, which enables a device (such as a smartphone, atablet pc, a home entertainment system, etc.) configured to display thevideo on a display and transmit lighting control commands based on thelighting control instructions of the light script to light sources of alighting system.

In embodiments wherein the processor 102 is configured to analyze thevideo to recognize the scene characteristic in other scenes of thatvideo, the processor 102 may be further configured to associate thelighting control instruction of the scene with one or more intermediaryscenes in between the scene and the further scene. This is illustratedin FIG. 3, which illustrates three images of three scenes 302, 304, 306of a movie wherein two cars approach a railway crossing. The first scene302 has a first scene characteristic, namely a red flashing railwaycrossing light 310. A user may, for example, select a lighting controlinstruction for the first scene 302 (e.g. a lighting control instructioncomprising a control command for controlling a light source such that itemits red flashing light). Upon identifying this first scenecharacteristic, the processor 102 may look for a similar/identicalcharacteristic in other scenes of the video. The processor 102 mayidentify the same red flashing railway crossing light 310 in the thirdscene 306, and associate the same lighting control instruction (i.e. thelighting control instruction comprising the control command forcontrolling the light source such that it emits red flashing light) withthe third scene 306. In the example of FIG. 3, the processor 102 mayassociate the same lighting control instruction (i.e. the lightingcontrol instruction comprising the control command for controlling thelight source such that it emits red flashing light) with the secondscene 304. As a result, when a user is watching this movie wherein thetwo cars approach the railway crossing, a light source will be flashingred light during the first, second and third scene, even though thefirst scene characteristic is not present during the second scene 304.This enhances the user experience of watching the movie.

The processor 102 may be configured to associate the lighting controlinstruction of the scene with the one or more intermediary scenes (only)if the time period between a scene having a certain characteristic and afurther scene having the same characteristic is shorter than apredefined time period. This is illustrated in FIG. 4a , wherein theprocessor 102 may identify a first characteristic C11 in a scene S11 andrecognize the same characteristic C11 in another scene S13. If the timeperiod TP between scenes S11 and S13 is below a threshold period, theprocessor 102 may associate the lighting control instruction L11 toscenes S11, to S13 and to intermediary scene S12.

The processor 102 may be configured to analyze the scene, the furtherscene and the one or more intermediary scenes, and to identify asecondary scene characteristic, different from the (initial) scenecharacteristic, in each of the scene, the further scene and the one ormore intermediary scenes. The processor 102 may be further configured toassociate the lighting control instruction of the scene with the one ormore intermediary scenes (only) if the secondary scene characteristichas been identified in the scene, the further scene and the one or moreintermediary scenes. This is illustrated in FIG. 4b , wherein theprocessor 102 may identify a first characteristic C21 in a scene S21 andrecognize the same characteristic C21 in another scene S24. Theprocessor 102 may further analyze the scene S21, the other scene S24 andthe intermediary scenes S22-S23 and identify a secondary scenecharacteristic C22 in these scenes S21-S24. The first characteristic C21may, for example, relate to a visual characteristic (e.g. a specificobject or person), and the second characteristic may, for example,relate to an auditory characteristic (e.g. background music). Basedthereon, the processor 102 may associate the lighting controlinstruction L21 with scenes S21, S24 and intermediary scenes S22-S23.

The processor 102 may be further configured to prompt a user to acceptor reject the association between the lighting control instruction andthe one or more intermediary scenes in between the scene and the furtherscene. The processor 102 may receive this acceptance/rejection via auser interface connected to the processor 102.

The processor 102 may be configured to identify at least one object,shape, character and/or person in the scene as the scene characteristic.The processor 102 may recognize the object, shape, character and/orperson by analyzing one or more images of the scene with known imageanalysis techniques. Similarly, the processor 102 may be configured toanalyze the other scenes of the video (or of another video) to identifythe at least one recognized one object, shape, character and/or personin one of those scenes. In a first example, wherein a certain actor hasbeen recognized in a scene, and a certain (user-defined) lightingcontrol instruction has been associated with that scene, that lightingcontrol instruction may be applied to all scenes wherein the actor hasbeen recognized. In a second example, wherein a certain object has beenrecognized in a scene, and a certain (user-defined) lighting controlinstruction has been associated with that scene, that lighting controlinstruction may be applied to all scenes wherein the object has beenrecognized.

Additionally or alternatively, the processor 102 may be configured toidentify at least one audio fragment in the scene as the scenecharacteristic. The processor 102 may recognize at least one audiofragment by analyzing the audio track of the scene. Similarly, theprocessor 102 may be configured to analyze the other scenes of the video(or of another video) to identify the at least one recognized at leastone audio fragment in one of those scenes. In a first example, wherein acertain sound effect has been recognized in a scene, and a certain(user-defined) lighting control instruction has been associated withthat scene, that lighting control instruction may be applied to allscenes where the sound effect has been recognized. In a second example,wherein a certain song has been recognized in a scene, and a certain(user-defined) lighting control instruction has been associated withthat scene, that lighting control instruction may be applied to allscenes wherein the song has been recognized.

The processor 102 may be configured to identify a plurality of scenecharacteristics in the scene. The processor 102 may be furtherconfigured to control a user interface to communicate the plurality ofscene characteristics to a user via the user interface. The userinterface may be configured to receive one or more user inputs (forexample touch inputs via a touch screen) representative of a selectionof one or more of the plurality of scene characteristics. A user mayselect one or more characteristics in the (initial) scene of the videowhich may subsequently be used for analysis of other scenes of the video(or the other video).

Additionally, a weight value may be provided for each scenecharacteristic. The weight value may be a priority value indicative ofwhich scene characteristic has the highest/lowest priority. The weightvalue may be based on a user input received via a user interface, basedon a number of occurrences of the scene characteristic in the video,based on the dominance of the scene characteristic in the scene (e.g.based on the size of an object/person), based on the presence of other(more/less prominent) scene characteristics in a scene, etc. FIG. 4cillustrates an example wherein the processor 102 may identify a firstcharacteristic C31 with a first weight value (for example a value of 6)in a first scene S31 and identify a second scene characteristic C32 witha second weight value (for example a value of 8) in a second scene S32.The processor 102 may further recognize both scene characteristics C31and C32 in a further scene S34. The processor 102 may determine, basedon the first and second weight values, to associate the lighting controlinstruction associated with the second scene C32 because the secondscene characteristic C32 has a higher weight value than the first scenecharacteristic C31.

FIG. 5 shows schematically an embodiment of a user interface of asoftware application for creating a light script for a video. In FIG. 5,the user interface may be displayed on a display 500. The user interfacemay comprise a video area 504 for displaying the video. The userinterface may further comprise a scene selector 530, for example aslider, which enables a user to select a scene of the video. Uponselecting the scene, the processor 102 may automatically determine alighting control instruction for that scene, or the user may select alighting control construction, for example by selecting 522 a color froma color picker 520. Alternatively, the user may select/pick a color onthe display area 504 (for example the color of the vehicle 506). Thecolor may be applied to one of the areas 510, 512, 514, 516 surroundingthe display area 504. The areas 510, 512, 514, 516 may be indicative ofpositions where the colors are to be created by light sources when videois being displayed. A user may, for example, select a first color for atop area 510, a second color for a left area 512, a third color for abottom area 514 and a fourth color for a right area 516. These colorsmay be saved in the light script for the selected scene, such that whenthe video is being displayed on a display, light sources positionedabove the display are controlled according to the first color, lightsources positioned right to the display are controlled according to thesecond color, light sources positioned below the display are controlledaccording to the third color and light sources positioned left to thedisplay are controlled according to the fourth color. After the lightingcontrol instruction has been defined by the user via the user interface,the processor 102 may analyze other scenes of the video to recognize, ina further scene, a scene characteristic (e.g. the vehicle 506 and/or thecharacter 508) of the initial scene.

FIG. 6 shows schematically a method 600 of creating a light script for avideo, the light script comprising lighting control instructions forcontrolling one or more light sources when the video is being displayed.The method 600 comprises:

analyzing 602 a scene of the video to identify a scene characteristic inthe scene,

analyzing 604 the video or another video to recognize, in a furtherscene, the scene characteristic, and

associating 606 a lighting control instruction with the scene and thefurther scene, such that when the scene and the further scenes are beingdisplayed the one or more light sources are controlled according to thelighting control instruction.

The method 600 may be executed by computer program code of a computerprogram product when the computer program product is run on a processingunit of a computing device, such as the processor 102 of the system 100.

It should be noted that the above-mentioned embodiments illustraterather than limit the invention, and that those skilled in the art willbe able to design many alternative embodiments without departing fromthe scope of the appended claims.

In the claims, any reference signs placed between parentheses shall notbe construed as limiting the claim. Use of the verb “comprise” and itsconjugations does not exclude the presence of elements or steps otherthan those stated in a claim. The article “a” or “an” preceding anelement does not exclude the presence of a plurality of such elements.The invention may be implemented by means of hardware comprising severaldistinct elements, and by means of a suitably programmed computer orprocessing unit. In the device claim enumerating several means, severalof these means may be embodied by one and the same item of hardware. Themere fact that certain measures are recited in mutually differentdependent claims does not indicate that a combination of these measurescannot be used to advantage.

Aspects of the invention may be implemented in a computer programproduct, which may be a collection of computer program instructionsstored on a computer readable storage device which may be executed by acomputer. The instructions of the present invention may be in anyinterpretable or executable code mechanism, including but not limited toscripts, interpretable programs, dynamic link libraries (DLLs) or Javaclasses. The instructions can be provided as complete executableprograms, partial executable programs, as modifications to existingprograms (e.g. updates) or extensions for existing programs (e.g.plugins). Moreover, parts of the processing of the present invention maybe distributed over multiple computers or processors.

Storage media suitable for storing computer program instructions includeall forms of nonvolatile memory, including but not limited to EPROM,EEPROM and flash memory devices, magnetic disks such as the internal andexternal hard disk drives, SSD, removable disks and CD-ROM disks. Thecomputer program product may be distributed on such a storage medium, ormay be offered for download through HTTP, FTP, email or through a serverconnected to a network such as the Internet.

1. A method of creating a light script for a video, the light scriptcomprising lighting control instructions for controlling one or morelight sources when the video is being displayed, the method comprising:receiving a user input indicative of a selection of a lighting controlinstruction for a scene, associating the lighting control instructionwith the scene, analyzing the scene of the video to identify a scenecharacteristic in the scene, analyzing the video or another video torecognize, in a further scene, a similar or identical scenecharacteristic, and associating, based on the recognition of the similaror identical scene characteristic, the lighting control instruction withthe further scene, such that when the scene and the further scene arebeing displayed the one or more light sources are controlled accordingto the lighting control instruction.
 2. The method of claim 1, furthercomprising: extracting one or more colors from one or more images of thescene, and generating the lighting control instruction based on the oneor more colors.
 3. The method of claim 1, wherein the lighting controlinstruction comprises color information, position information and/ortiming information for controlling the one or more light sources.
 4. Themethod of claim 1, wherein the method further comprises associating thelighting control instruction with one or more intermediary scenes of thevideo in between the scene and the further scene.
 5. The method of claim4, wherein the step of associating the lighting control instruction withthe one or more intermediary scenes is executed if a time period betweenthe scene and the further scene is below a threshold time period.
 6. Themethod of claim 4, further comprising the steps of: analyzing the scene,the further scene and the one or more intermediary scenes, identifying asecondary scene characteristic, different from the scene characteristic,in each of the scene, the further scene and the one or more intermediaryscenes, wherein the step of associating the lighting control instructionwith the one or more intermediary scenes is executed if the secondaryscene characteristic has been identified in the scene, the further sceneand the one or more intermediary scenes.
 7. The method of claim 1,wherein the step of analyzing the scene to identify the scenecharacteristic comprises identifying at least one object, shape,character and/or person in the scene, and wherein the step of analyzingthe video or another video to recognize, in the further scene, the scenecharacteristic comprises recognizing the at least one recognized oneobject, shape, character and/or person in the further scene.
 8. Themethod of claim 1, wherein the step of analyzing the scene to identifythe scene characteristic comprises identifying at least one audiofragment in the scene, and wherein the step of analyzing the video oranother video to recognize, in the further scene, the scenecharacteristic comprises recognizing the at least one recognized audiofragment in the further scene.
 9. The method of claim 1, wherein thestep of analyzing the scene to identify the scene characteristic in thescene comprises identifying a plurality of scene characteristics in thescene, and wherein the method further comprises: communicating theplurality of scene characteristics to a user via a user interface,receiving one or more user inputs representative of a selection of oneor more of the plurality of scene characteristics, and wherein theanalysis of the video or another video comprises recognizing, in thefurther scene, the one or more selected scene characteristics.
 10. Themethod of claim 1, wherein the method further comprises: obtaining afirst weight value for a first scene characteristic in a first sceneassociated with a first lighting control instruction, obtaining a secondweight value for a second scene characteristic in a second sceneassociated with a second lighting control instruction, and associating,if the first and second scene characteristics are recognized in thefurther scene, the first or the second lighting control instruction withthe further scene based on the first and second weight values.
 11. Themethod of claim 1, further comprising, before associating the lightingcontrol instruction with the further scene, receiving a user inputindicative of an acceptance of the association between the lightingcontrol instruction and the further scene.
 12. The method of claim 1,further comprising storing the light script as a computer readable file,or embedding the light script in a video file of the video.
 13. Acomputer program product for a computing device, the computer programproduct comprising computer program code to perform the method of claim1 when the computer program product is run on a processing unit of thecomputing device.
 14. A system for creating a light script for a video,the light script comprising lighting control instructions forcontrolling one or more light sources when the video is being displayed,the system comprising: a user interface configured to receive a userinput indicative of a selection of a lighting control instruction for ascene, and a processor configured to associate the lighting controlinstruction with the scene, analyze the scene, to identify a scenecharacteristic in the scene, analyze the video or another video toidentify, in a further scene, a similar or identical scenecharacteristic, and to associate, based on the recognition of thesimilar or identical scene characteristic, the lighting controlinstruction with the further scene, such that when the scene and thefurther scene are being displayed the one or more light sources arecontrolled according to the lighting control instruction.